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What Is Claimed Is : 

1 1 . A method comprising: 

2 intercepting a call from an executing program to a library function, 

3 wherein said function call requests writing of a data block to the heap section of 

4 a memory; 

5 determining whether performing said write request would smash the 

6 heap; 

7 executing an error handling procedure instead of writing the data block if 

8 performing said write request would smash the heap; and 

9 causing the data block to be written as requested if performing said write 

10 request would not smash the heap. 

a .. 

2 i 2. The method of claim 1 , wherein if writing the data block as requested 

IssJ 

Q 2 would overflow a buffer in the heap, then the conclusion of said determining 

J 3 step is that performing the write request would smash the heap. 

is: 

Ui i 3. The method of claim 1 , wherein a parameter accompanying said function 

Jf j 2 call is a start address of a destination memory section where the data block is 

42 3 requested to be written, and wherein determining whether performing said write 

O 

U 4 request would smash the heap comprises: 



5 determining the size of the data block to be written; 

6 determining whether the destination start address is located within a 

7 currently allocated buffer in the heap; 

8 concluding that performing said write request would smash the heap if 

9 the destination start address is not within any currently allocated buffer; and 

10 concluding that performing said write request would smash the heap if 
n the destination start address is within an identified buffer and said data block's 

12 size is greater than the size of the memory section extending from the 

13 destination start address to the end of said identified buffer. 
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1 4. The method of claim 3, wherein each currently allocated buffer contains 

2 a meta-data field, and wherein determining whether the destination start 

3 address is within a currently allocated buffer comprises: 

4 searching the heap in one direction for a meta-data field, wherein the 

5 search begins at the destination start address; and 

6 determining that the destination start address is not within any currently 

7 allocated buffer if the search reaches a heap boundary without finding a valid 

8 meta-data field. 

1 5. The method of claim 4, wherein a potential meta-data field is identified by 

2 finding a predefined marker in a memory location being examined during the 
iM, 3 search. 

Q i 6. The method of claim 4, wherein each currently allocated buffer is 

y 2 associated with an entry in a buffer management table, and wherein a section 

J 3 of memory is identified as a meta-data field only if that memory section contains 

f 4 a pointer to an entry in the buffer management table. 

iPf 

v i i 7. The method of claim 6, wherein the memory section is confirmed to be a 

$3 2 meta-data field only if the buffer management table entry pointed to also 

3 contains a pointer to an address of a memory location in said meta-data field. 

1 8. The method of claim 4, wherein the search for a valid meta-data filed 

2 assumes that each memory buffer is aligned at a boundary that is proportional 

3 to its size. 

1 9. The method of claim 1 , wherein said step of intercepting a function call is 

2 provided for by a dynamic link loader resolving to the fault containment wrapper 

3 any references to the function in the executing program. 
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1 10. The method of claim 1 , wherein causing the data to be written as 

2 requested comprises: 

3 determining whether the function was previously called; 

4 resolving the called function through an interface function of the dynamic 

5 link loader, if the function was not previously called; and 

6 returning without calling the function again if the function was previously 



7 called. 

1 11. An article of manufacture comprising a computer-readable medium 

2 having stored thereon instructions which instructions comprise a fault- 

U 3 containment wrapper module for library function calls, wherein said instructions 

J;{ 4 when executed cause the processor to: 

Q 5 receive an intercepted call from an executing program to a library 

0 

y 6 function, wherein said function call requests writing of a data block to the heap 

<m 

^ 7 section of a memory; 

* 8 determine whether performing said write request would smash the heap; 

Q 9 execute an error handling procedure instead of writing the data block if 

^ io performing said write request would smash the heap; and 
Q li cause the data block to be written as requested if performing said write 

12 request would not smash the heap. 

1 1 2. The article of manufacture of claim 1 1 , wherein said determining step 

2 concludes that writing the data block as requested would overflow a buffer in 

3 the heap if the instructions determine that performing the write request would 

4 smash the heap. 
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1 1 3. The article of manufacture of claim 1 1 , wherein one parameter 

2 accompanying said function call is a start address of the memory section where 

3 the data block is requested to be written, and wherein the instructions 

4 determine whether performing said write request would smash the heap by: 

5 determining the size of the data block to be written; 

6 determining whether a destination start address is located within a 

7 currently allocated buffer in the heap; and 

8 concluding that performing said write request would smash the heap if 

9 the destination start address is not within any currently allocated buffer; and 

10 concluding that performing said write request would smash the heap if 



2 n the destination start address is within an identified buffer and said data blocks 

Q 12 size is greater than the size of the memory section extending from the 

X 13 destination start address to the end of said identified. 

M 

m 

JS i 14. The article of manufacture of claim 13, wherein each currently allocated 

jy. 2 buffer contains a meta-data field, and wherein said determining whether the 

W 3 destination start address is within a currently allocated buffer comprises: 
4* 4 searching the heap in one direction for a meta-data field, wherein the 

fj 5 search begins at the destination start address; and 

6 determining that the destination start address is not within any currently 

7 allocated buffer if the search reaches a heap boundary without finding a valid 

8 meta-data field. 

1 1 5. The article of manufacture of claim 14, wherein a potential meta-data 

2 field is identified by finding a predefined marker in a memory location being 

3 examined during the search. 
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1 1 6. The article of manufacture of claim 14, wherein each currently allocated 

2 buffer is associated with an entry in a buffer management table, and wherein a 

3 section of memory is identified as a meta-data field only if that memory section 

4 contains a pointer to an entry in the buffer management table. 

1 17. The article of manufacture of claim 16, wherein the memory section is 

2 confirmed to be a meta-data field only if the buffer management table entry 

3 pointed to also contains a pointer to an address of a memory location in said 

4 meta-data field. 

1 18. The article of manufacture of claim 14, wherein the instructions to search 

2 for a valid meta-data filed assume that each memory buffer is aligned at a 

3 boundary that is proportional to its size. 

1 19. The article of manufacture of claim 14, wherein intercepting of the 

2 function call is provided for by a dynamic link loader resolving to the fault 

3 containment wrapper any references to the function in the executing program 

1 20. The article of manufacture of claim 14, wherein the instructions cause 

2 the data to be written by: 

3 determining whether the function was previously called; 

4 resolving the called function through an interface function of the dynamic 

5 link loader if the function was not previously called; and 

6 returning without calling the function again if the function was previously 

7 called. 
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1 21 . A method comprising: 

2 intercepting a call to a library function, wherein the function call provides 

3 for writing a data string to a block of addresses within a heap section of a 

4 memory; and 

5 initiating a fault-containment wrapper to perform steps that comprise: 

6 determining whether writing the data string to the block of 

7 addresses would overflow a buffer within the heap; 

8 causing the data string to be written to the block of addresses if it 

9 was determined that said writing would not overflow a buffer; and 

10 executing an error handling procedure if it was determined that 
h ii said writing would overflow a buffer. 

M 

w 

Q i 22. The method of claim 21 , wherein determining whether writing the data 

J|| 2 string to the block of addresses would overflow a buffer comprises: 
:s H 3 concluding that said writing would overflow a buffer whenever both: 

f* 4 a first address within said block of addresses is within a currently 

«y 5 allocated buffer in the heap; and 

4* 6 the distance from said first address to the address of a last location in 

Q 

p 7 said currently allocated buffer is less than the size of the data string. 

1 23. The method of claim 22, wherein the fault-containment wrapper also 

2 keeps track of the allocation of buffers in the heap, and wherein information 

3 about the buffer allocation is stored in a buffer allocation data structure. 

1 24. The method of claim 23, wherein the method further comprises 

2 determining whether the first address is within said block of addresses within a 

3 currently allocated buffer based on information from the buffer allocation data 

4 structure. 
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1 25. The method of claim 24, the method further comprises: 

2 searching the memory linearly from said first address within said 

3 block of addresses for a buffer marker; 

4 confirming whether an actual buffer marker has been found in said 

5 search by using information in said buffer allocation data structure; and 

6 concluding that the first address within said block of addresses is 

7 not within a currently allocated buffer if the linear search reaches a 

8 boundary of the heap without confirming that a buffer marker has been 

9 found. 

H l 26. The method of claim 25, wherein the search for a valid buffer marker 

Q 

p 2 assumes that each memory buffer is aligned at a boundary that is proportional 

J*J 3 to its size. 

Q 

2 l 27. A fault-containment wrapper for detecting heap buffer overflow, the fault- 

f 2 containment wrapper comprising instructions to: 

3 determine whether writing the data string to the block of 



4 addresses would overflow a buffer within the heap; 

5 cause the data string to be written to the block of addresses if it 

6 was determined that said writing would not overflow a buffer; and 

7 execute an error handling procedure if it was determined that said 

8 writing would overflow a buffer. 
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1 28. The fault-containment wrapper of claim 27, wherein the fault-containment 

2 wrapper further comprises instructions to conclude that said writing would 

3 overflow a buffer whenever both: 

4 a first address within said block of addresses is within a currently 

5 allocated buffer in the heap; and 

6 the distance from said first address to the address of a last location in 

7 said currently allocated buffer is less than the size of the data string. 

1 29. The fault-containment wrapper of claim 27, wherein the fault-containment 

2 wrapper also keeps track of the allocation of buffers in the heap, and wherein 
M 3 information about the buffer allocation is stored in a buffer allocation data 

n 4 structure. 



m 



1 30. The fault-containment wrapper of claim 27, wherein the fault-containment 

2 wrapper further comprises instructions to: 

f 3 search the memory linearly from said first address within said block of 

Cf 4 addresses for a buffer marker; 

pi 



5 confirm whether an actual buffer marker has been found in said memory 

p 6 being searched by using information in said buffer allocation data structure; and 

7 conclude that the first address within said block of addresses is not 

8 within a currently allocated buffer if the linear search reaches a boundary of the 

9 heap without confirming that a buffer marker has been found. 



1 31 . The fault-containment wrapper of claim 30, wherein the search for a valid 

2 buffer marker assumes that each memory buffer is aligned at a boundary that is 

3 proportional to its size. 
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